Technical Paper
Probabilistically Extended Ontologies a basis for systematic testing of ML-based systems
2024-07-02
2024-01-3002
Autonomous driving is a hot topic in the automotive domain, and there is an increasing need to prove its reliability. They use machine learning techniques, which are themselves stochastic techniques based on some kind of statistical inference. The occurrence of incorrect decisions is part of this approach and often not directly related to correctable errors. The quality of the systems is indicated by statistical key figures such as accuracy and precision. Numerous driving tests and simulations in simulators are extensively used to provide evidence. However, the basis of all descriptive statistics is a random selection from a probability space. The difficulty in testing or constructing the training and test data set is that this probability space is usually not well defined. To systematically address this shortcoming, ontologies have been and are being developed to capture the various concepts and properties of the operational design domain.